Understanding visual map formation through vortex dynamics 
of spin Hamiltonian models 
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The pattern formation in orientation and ocular dominance columns is one of the most inves- 
tigated problems in the brain. From a known cortical structure, we build spin-like Hamiltonian 
models with long-range interactions of the Mexican hat type. These Hamiltonian models allow a 
coherent interpretation of the diverse phenomena in the visual map formation with the help of re- 
laxation dynamics of spin systems. In particular, we explain various phenomena of self-organization 
in orientation and ocular dominance map formation including the pinwheel annihilation and its 
dependency on the columnar wave vector and boundary conditions. 

PACS numbers: 42.66.-p, 87.10.+e, 75.10.Hk, 89.75.Fb 



A series of experiments have suggested that important 
elements of the organization of ocular dominance (OD) 
and orientation preference (OP) maps in the striate cor- 
tex are not prespecified but emergent during an activity- 
driven, self-organizing process • An optical imag- 
ing technique [J, |a, |fj revealed the detailed maps of OD 
and OP over small patches of the cortex, which prompted 
several models for the map generation in the brain and 
various attempts for the analysis of the properties in the 
observed cortical map patterns 0, • 

In the experimentally observed OP columnar patterns, 
there are two prominent features: (1) singular points (so 
called "pinwheels" ) are point- like discontinuities around 
which the orientation preference changes by multiples of 
180° along a closed loop, and (2) linear zones are re- 
gions where iso-orientation contours (IOCs) are straight 
and run in parallel for a considerable distance |9 L |l0 L 1 1 11 ] . 
The analysis of competitive Hebbian models [13, [l3j pre- 
dicted the bifurcation between homogeneous and inho- 
mogeneous solutions depending on the cooperation range 
a and the change in the wavelength A [Til ITil Hfj| . Linear 
zones in OP columns or OD bands arc features of the in- 
homogeneous states. Some experimental or simulational 
results suggested that pinwheels are not permanent struc- 
tures but can be annihilated during the course of active- 
dependent development [ItI llij l . The perpendicular in- 
tersection of IOCs and OD bands with the margin of the 
striate cortex has been also reported 0, H(| . There are 
some evidence that patterns in OP and OD columns are 
not independent but correlated. Pinwheels have a ten- 
dency to align with the centers of OD bands and IOCs 
intersect the borders of OD bands at a steep angle [l9j . 
The influence of the interactions between OP and OD 
columns on the pinwheel stability was described |l7|. 

In this paper, we propose a new visual map forma- 
tion method with neighborhood interactions. The corti- 
cal map generation is described by spin-like Hamiltoni- 
ans with distance dependent interactions. The statisti- 
cal analysis of these Hamiltonians leads to the success- 



ful description of several pattern properties observed in 
vivo. In our analogy, the progress in the visual map for- 
mation corresponds to relaxation dynamics in spin sys- 
tems, where, for example, the pinwheels in OP can be 
regarded as (in-plane) vortices. The pinwheel instability 
and its annihilation rate are explained in terms of the 
free energy of the topological excitation or the Kosterlitz 
and Thouless transition temperature |2l|. Our model 
with neighborhood interaction exhibits the bifurcation 
between the homogeneous and inhomogeneous states de- 
pending on the inhibitory activity strength k in lateral 
currents. The columnar wavelength and the correlation 
function of the OP maps are also derived from out model. 
The extension of our model to the 0(3) or the Heisenberg 
model induces the correlation between the OP and OD 
columns, which leads to the orthogonality between IOCs 
and the borders of OD bands, and allows OD columns 
to influence on the pinwheel stability. Another orthogo- 
nal tendency of the cortical maps with area boundaries 
is explained from the equilibrium condition. 

The six layers in the neocortex can be classified into 
three different functional types. The layer IV neurons 
first get the long range input currents, such as signals 
from the retina via the lateral geniculate nucleus (LGN) 
of the thalamus, and send them up vertically to layer II 
and III that are called the true association cortex. Out- 
put signals are sent down to the layer V and VI, and sent 
further to the thalamus or other deep and distant neural 
structures. Lateral connections also occur in the superfi- 
cial (layer II and III) pyramidal neurons and have usual 
antagonistic propensity which sharpens responsiveness to 
an area. However, the superficial pyramidal neurons also 
send excitatory recurrent to adjacent neurons due to un- 
myelinated collaterals. Horizontal or lateral connections 
have such distance dependent (so called "Mexican hat" 
shaped) excitatory or inhibitory activity. Some bunches 
of neurons make columnar clusters called minicolumns 
and such aggregations are needed to consider higher di- 
mensional properties of processing elements |22l l23| . 
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Now we propose a Lie algebraic representation method 
for the feature vectors in cortical maps, called the fibre 
bundle map (FBM) model. This starts from the assump- 
tion that the total space E is composed of the lattice (or 
base) space B and the pattern (or fibre) space F. A tran- 
sition function (or symmetry) group G of a homcomor- 
phism of the fibre space F is necessary to describe what 
happens if there is "excitatory" or "inhibitory" activity. 
The symmetry group G is important since it determines 
what interactions are possible. In the visual cortex, G 
takes 0(3) rather than 0(2) x Z2 because of the correla- 
tions between OP and OD columns. 

If there are stimuli from lateral and LGN neurons in 
the OP columns, the changes in preferred angles <j>i (0 < 
(pi < 7r) for i-th neuron group are described by 



-g = -2£^J(f i ,f J -)sin(2^-2^) 

i 
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where e and \x are the change rates in the stimuli from 
lateral and LGN cells, respectively, and B and 4>' are 
the strength and the phase of LGN stimulus. We use 
the lateral neighborhood interaction function /, modified 
from a wavelet, as 



(ri,fj) = 1 - k 



"-"' 2 Wi^ft. (2) 



Note that there is also another well-known Mexican hat 
shaped function called the difference of Gaussians (DOG) 
filter, Idog{t) = exp(-r 2 /2er 2 ) - fc cxp(-r 2 /2cr 2 ). We 
rewrite Eq. as a gradient flow with the Hamiltonian 



h = —y]j(fj, rj)Sj ■ Sj - y] hi ■ Sj 



(3) 



where J(r\,fj) — |J(f^,fj-) is site distance dependent 
interaction energy. The site states Sj = (cos 2<j) i , sin 2^) 
and the external stimuli h; = (/i£?i cos 2<//, fiBi sin 2^) 
are 2-components vectors. In this form, H is similar to 
spin models in statistical physics. In the case of OD 
maps, Si has a one-component with ±1 values similar to 
the Ising model. There were some previous studies on 
spin models with distance dependent interactions, albeit 
mostly in the form of J(r) ~ r~ a |H |H H3 • 

The Hamiltonian in Eq.@ can be easily diagonalized 
in the momentum space: 



H = - E J ® s ? • s -«- - E v s -«' 



(4) 



where J(q) = £ r -J(r) e - l «", S ? = ^Ei^'^ an d 
hg- = — = J^i hie~ l ^' ri . We assume that the LGN stimuli 
for a given neuron is uniform with no preferred angle, 
so that the second term in Eq. Q is neglected without 
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FIG. 1: The plot of J(0) - J(q) vs q in Eq. 0. For k > k c 
(=1/4), the minimum point at q* = becomes unstable. 



random fluctuations effect. In the continum limit, we 
obtain 



J(q) ~ 7T£— (1 - 2k + ka 2 q 2 )e 



(5) 



where a is the lattice constant. J(q) has the maximum 
at q* = for k < k c (=1/4) and at q* = - T/k 

for k > k c (Fig. [TJ. Therefore, there is a threshold de- 
pending on k c below which OP slabs or OD bands are 
forbidden. Above k c , columnar patterns emerge with the 
wavelength A = 2ir/q*, which decreases as k increases 
(Fig. 0(b) and (c)). 

In the simulations of the OP map formation starting 
from a random state by Eq. Q, dense pinwheels first 
emerge with the spin- waves for k < k c (Fig. (a)) as 
for the classical XY model. Then pinwheels start to an- 
nihilate in pairs and eventually the map approaches a 
homogeneous state. For k > k c (Fig. (b) and (c)), 
pinwheels emerge with the columnar patterns and are 
annihilated in time as well. The OP map will eventu- 
ally approach the equilibrium state that is composed of 
a uni-directional plane-wave, the winner in the competi- 
tion among \q\ — q* states. 

By using the parabolic behavior of —J{q) near the min- 
imum point q* , the Hamiltonian can be approximated as 



#--E 



j(q*) + lj"(q*)W-t\ 2 



SfS-f (6) 



or the effective Hamiltonian as a function of the preferred 
orentation <p is given by 



-NJ, 



■J,, 



df\2V(/)-q*\ 2 , 



(7) 



where J s = J(q*), J p = -J"{q*)/a 2 (= 2ne^{Ak - 
l)exp(— 2 + l/2fc) for k > k c ), and both J s and J p are 
positive for all k. The term q* in Eq. l|7jl. which makes 
plane- wave solutions, does not contribute to the pinwheel 
formation energy since V x V0 pu , = and the line in- 
tegral around any contour vanishes by Stoke's theorem. 
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(a) k = 0.2 



(b) k = 0.3 




(c) k = 1.0 
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FIG. 2: Simulation results of the OP map using Eq. ft} . 
Maps are generated with cr 2 = 6, e = 10~ 3 , /i = 0, periodic 
boundary conditions and an initially random state in 70 x 70 
lattice. 



Just adapting the results in vortex dynamics |21| , we can 
obtain the change in free energy due to the formation of 
a pinwheel, AG = (ttJ p — 2ksT) ln(L/a), and the phase 
transition temperature, Tkt = 7rJ p /2fcs. 

The visual cortex arises through activity-dependent re- 
finement of initially unselective patterns of synaptic con- 
nections, whereas dense pinwheels emerge when orienta- 
tion selectivity is first established and the density of pin- 
wheels decreases by annihilation in time. The observed 
pinwheel densities differ in several species and such dif- 
ference in the pinwheel annihilation rates has been dis- 
cussed by Wolf et al. 0. Now we can predict the rela- 
tive pinwheel annihilation rates in terms of AG or Tkt'- 
(i) As k increases for k > k c , J p increases and the pin- 
wheels become more unstable. For fixed e and a, A 
decreases as k increases and the map with a narrower 
wavelength relaxes to the equilibrium state more rapidly 
(Fig. |21 (b) & (c)). (ii) As a increases, pinwheels be- 
come more unstable. But A is proportional to cr, and the 
map with a narrower wavelength relaxes to the equilib- 
rium state more slowly in this case, (iii) The parameter 
£ can be regardes the activity rate responding to exter- 
nal stimuli or the learning rate due to the Hebbian rule. 
The annihilation rate becomes larger for larger e. (iv) 
Thermal fluctuations may lead to the persistence of the 
pinwheel structure but they also disturb the map organi- 
zation, (v) There are pinwheel annihilation mechanisms 
by collisions not only between opposite vortices but also 
with area boundaries. The probability of a collision with 
area boundaries decreases as the lattice size increases for 
randomly moving pinwheels. (vi) To include the inter- 



actions between OD and OP columns, our model has to 
be extended to the 0(3) symmetry or Heisenberg model. 
The classical anisotropic Heisenberg model is described 
by 



H = -K^(S?S] 

(ij) 



sfs^ 



XSfS* 



(8) 



where K > 0. For this model, Tkt is known to approach 
as A approaches 1 [28|. This result can be translated 
as follows: the pinwheel structures last longer or even 
become stabilized through strong activity of OD column. 

The extension to the Heisenberg model also explains 
the observed orthogonal property between the borders of 
OD bands and the IOCs. Let us consider the gradient 
or normal vectors of IOCs at S x — and S y — 0. These 
two vectors intersect perpendicularly at pinwheels. The 
borders of the opposite OD domains can be represented 
as S z = 0, which will meet also perpendicularly with 
other contours, S x = or S y = 0. Therefore, the borders 
of OD bands are mathematically equivalent to IOCs and 
intersect perpendicularly with each other (Fig. ■ 

The correlation function in the OP maps is obtained 
from Eq. @ as 



(S(r).S(0)> =g(r)^J (q*r) (£) 



-k B T/2TrJ p 



(9) 



where Jo is the zeroth Bessel function. As the map re- 
laxes to the equilibrium state, the correlation function is 
expected to approach the distribution in Eq. ©. This 
is consistent with the experimens 7] and the numerical 
simulations (Fig. H}. 

The perpendicularity with the margin of the striate 
cortex is derived from the equilibrium condition SH/ 6<j) ~ 
or V 2 ~ 0. The normal component of V(/> vanishes 
at the area boundary since the integral along a narrow 
rectangular loop over the area boundary, <f> c V0 • dri, van- 
ishes due to the divergence theorem. Such perpendicu- 
larity with the area boundary is also manifested in other 
static field solutions, such as the magnetic field, and is 
consistent with the observed OD patterns in vivo (Fig.JSJ. 




FIG. 3: (a) An simulation result of OP and OD columnar pat- 
terns using Eq. © with S = (S x , S y , S z ) and (b) its detailed 
contour feature in a white rectangle (non-periodic boundary 
conditions). The blue lines correspond to — (</> — ? or 



4p) domains and the red lines, S y 



or 2-) domains. 



The black lines are the borders of opposite OD (or S z = 0) 
domains in both figures. 
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FIG. 4: (a) Normalized autocorrelation function g(r) of the 
simulation results in Fig. [5] (c) at t — 5 and (b) t = 100. (c) 
The zeroth Bessel function Jo(q*r). 




FIG. 5: The complete pattern of OD stripes in the striate 
cortex of a macaque monkey. There is a strong tendency for 
the stripes to meet the margin of striate cortex at steep or 
right angles (LeVay [20|. Copyright 1985 by the Society for 
Neuroscience) . 

The interactions in cortical circuitry and the synaptic 
plasticity are more complex processes in vivo and var- 
ious cortical modification rules are postulated by other 
models. Competitive Hebbian models also provide some- 
what successful description of the map formation based 
on the different assumption that neurons compete with 
neighborhoods and get more stimuli close to their pre- 
ferred angle. Then the second term in Eq.® from LGN 
stimuli will no longer vanish upon averaging. However, 
both non-competitive and competitive models can gener- 
ate and predict similar pattern properties without much 
differences. The FBM model, named from the fibre bun- 
dle theory in manifold, explains the emerging patterns in 
cortical map with differential geometric concept that the 
major features of self-organizing map are determined not 
by the detailed interactions of processing elements but 
by lattice geometry, symmetry group and connections in 
phase space (that is q* in our problem). 

The correlations between the OP and OD columns 
through 0(3) symmetry come from the normalization of 
synapse strength. If the OP and OD columns have dif- 
ferent interaction strength, the total system would be de- 
scribed by an easy-plane (or XY symmetry) Heisenberg 
model. The comprehensive understanding of distance de- 
pendent anisotropic Heisenberg models is not an easy by 
itself and is as an important issue also in condense mat- 
ter physics, the study of which will have important im- 



plications in understanding the effects of the interactions 
between OP and OD columns in the visual cortex. 
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